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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the marling date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, nnay reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )[E1 Responsive to communication(s) filed on 29 December 2000 . 
2a)n This action is FINAL. 2b)IEI This action is non-final. 

3) n Since this application is in condition for allowance except for formal nnatters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 1-67 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration, 

5) 0 Claim(s) is/are allowed. 

6) M Claim(s) 1-2226-44,59-61 and 63-67 \slare rejected. 

7) [E1 Claim(s) 23-25.45-58 and 62 is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) |EI The specification is objected to by the Examiner. 

10) n The drawing(s) filed on is/are: ajD accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121 (d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C, § 119 

12) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or(f). 
a)n All b)n Some * c)^ None of: 

1 .[m Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application Mo. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1) Notice of References Cited (PTO-892) 

2) CH Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) ^ Infonnation Disclosure Statennent(s) (PTO-1449 or PTO/SB/08) 

Paper No(s)/Mail Date 3/28/01 . 



4) n Interview Sunnmary (PTO-413) 

Paper No(s)/Mail Date. , • 

5) □ Notice of Infomnal Patent Application (PTO-152) 

6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 1-04) 
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DETAILED ACTION 



Specification 



1. Applicant is reminded of the proper language and format for an abstract of the disclosure. 

The abstract should be in narrative form and generally limited to a single paragraph on a 
separate sheet within the range of 50 to 150 words. It is important that the abstract not exceed 
150 words in length since the space provided for the abstract on the computer tape used by the 
printer is limited. The form and legal phraseology often used in patent claims, such as "means" 
and "said," should be avoided. The abstract should describe the disclosure sufficiently to assist 
readers in deciding whether there is a need for consulting the fiill patent text for details. 

The language should be clear and concise and should not repeat information given in the 
title. It should avoid using phrases which can be imphed, such as, "The disclosure concerns," 
"The disclosure defined by this invention," "The disclosure describes," etc. 

Allowable Subject Matter 



2. Claims 23-25,45-58 and 62 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 



3. The following is a statement of reasons for the indication of allowable subj ect matter: 

As per claims 45-58 and 62, the recited limitations pertaining to the structure of 
the apparatus in storing, allocating, and decision making with respect to storing and accessing 
behavioral codes is not explicitly taught by the prior art of record. 
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Claim Rejections - 35 USC §102 



4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 



5. Claims 1-22,26-44,59-61,63-67 are rejected under 35 U.S.C. 102(e) as being anticipated 
by Hatlelid et al (6404438) . 

As per claims 1,28, Hatlelid et al (6404438) teaches a method for interpreting 
nonverbal communicative behavior of an individual (as interpreting utterances to identify 
behavior (coL 1 lines 55-61; col. 9 lines 55-65) comprising: 

"observing. . ..individual" as recording a behavior (col. 1 lines 58-62); 

"acquiring access explanation" as accessing stored behavioral rules (col. 2 

hens 25-39); 

"assigning. ...behavior" as assignment to behaviors (Fig. 3b); 

"comparing codes" as comparing observed contexts to existing stored 

associations between previous utterances and behaviors (col. 2 lines 64-67); 

"retrieving the explanation. . ..code" as suing the behavioral information to match 
the code (col. 7 lines 20-37). 



Application/Control Number: 09/751,504 Page 4 

Art Unit: 2655 

As per claims 2,28, Hatlelid et al (6404438) teaches storing the observed behavior 
(col. 12 lines 10-18). 

As per claims 3,28, Hatlehd et al (6404438) teaches storing in segments (as 
segmented files - fig. 4b, fig. 8). 

As per claims 4,19, Hatlehd et al (6404438) teaches accessing and interpreting 
behavior codes (as automatic searching of behavior codes, that are based on previous 
information, to determine interpret the new utterance/input -- col. 3 lines 10-30). 

As per claims 5,7, Hatlelid et al (6404438) teaches compressed information into 
fi*ames (Fig. 8). 

As per claim 6, Hatlehd et al (6404438) teaches string of audio and image fi^ames 
(fig. 14a, and 14b) 

As per claim 8, Hatlelid et al (6404438) teaches recognizing behavior units, 
assigning a unit code, and combining the two (as mapping of mood and personality into 
behavioral movement ~ fig. 3b) 



4a). 



As per claims 9,17, Hatlehd et al (6404438) teaches gesture and sound units (Fig. 
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As per claim 10, Hatlelid et al (6404438) teaches synchronized gesture and sound 
units to form behavior code (fig. 5). 

As per claim 11, HatleHd et al (6404438) teaches chronological order of the 
behavior units (as keeping track of playback and duration ID - fig. 14b) 

As per claim 12, Hatlelid et al (6404438) teaches adding/modifying the behavior 
code if it surpasses a threshold (col. 26 line 64 - col. 27 line 9). 

As per claim 13, Hatlelid et al (6404438) teaches storage in a database (col. 8 

lines 40-50). 

As per claim 14, Hatlelid et al (6404438) teaches user ID to edit the association 
(col, 7 liens 10-18). 

As per claims 15,21, Hatlelid et al (6404438) teaches weighting the characteristics 
into subsets (col. 8 lines 55-65). 



As per claim 16, Hatlelid et al (6404438) teaches searching, matching, and 
prioritizing the behavior codes (col. 8 lines 55-65). 
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As per claim 18, Hatlelid et al (6404438) teaches the recited claim limitations 
common to claim 1 as noted above in the rejection of claim 1. Furthermore, as per claim 18, 
Hatlelid et al (6404438) teaches noting and identifying a plurality of behaviors, generating a 
collection of behaviors, and noting the associated codes with the succession of behaviors (coL 25 
line 55 - col. 26 line 67). 



As per claim 22, Hatlehd et al (6404438) teaches generating context and images 
based on the certain part of the conversation (col 26 lines 25-45). 



As per claim 26, and 27, Hatlelid et al (6404438) teaches a plurality of moods and 
emotions for the user to transmit, along with gestures (col 24 line 12 - eel. 60)/ 

Claims 29-44,65-67 are directed toward an apparatus which implement the 
method claimed in claims 1-28, and are similar in scope and content and are rejected under 
similar rationale. 



As per claims 59-67 Hatlehd et al (6404438) teaches the system to be performed 
over server based systems (col. 5 lines 1-15), incorporating modules into each user's application 
(col. 5 lines 6-10), based on internet protocols (col. 5 lines 15-25; col. 5 lines 40-5 1); using more 
than one remote location (col. 5 lines 54-60); sending different information based on the 
user(col. 9 lines 46 -65; col. 10 lines 38-49;col. 12 lines 32-65); 
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Conclusion 



6. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. Please see related art listed on the PTO-892 form. 



7. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or faxed to: 
(703) 872 9314, 

(for informal or draft communications, please label "PROPOSED" or 
"DRAFT") 

Hand-delivered responses should be brought to Crystal Park II, 2121 
Crystal Drive, Arlington. VA., Sixth Floor (Receptionist). 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael Opsasnick, telephone number (703)305-4089, 
who is available Tuesday-Thursday, 9am-4pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ms. Doris To, can be reached at (703)305-4827. The facsimile phone number 
for this group is (703)872-9306. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Group 2600 receptionist whose telephone number is 
(703) 305-4750, the 2600 Customer Service telephone number is (703) 306-0377. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 



mno 
12/7/04 
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